Validating the implementation of an indicator reporting policies and laws on free public maternal health-related services in the era of universal health coverage: A multi-country cross-sectional study.

BACKGROUND: The concept of universal health coverage (UHC) encompasses both access to essential health services and freedom from financial harm. The World Health Organization's Maternal Newborn Child and Adolescent Health (MNCAH) Policy Survey collects data on policies that have the potential to reduce maternal morbidity and mortality. The indicator, "Are the following health services provided free of charge at point-of-use in the public sector for women of reproductive age?", captures the free provision of 13 key categories of maternal health-related services, to measure the success of UHC implementation with respect to maternal health. However, it is unknown whether it provides a valid measure of the provision of free care. Therefore, this study compared free maternal healthcare laws and policies against actual practice in three countries. METHODS AND FINDINGS: We conducted a cross-sectional study in four districts/provinces in Argentina, Ghana, and India. We performed desk reviews to identify free care laws and policies at the country level and compared those with reports at the global level. We conducted exit interviews with women aged 15-49 years who used a component service or their accompanying persons, as well as with facility chief financial officers or billing administrators, to determine if women had out-of-pocket expenditures associated with accessing services. For designated free services, prevalence of expenditures at the service level for women and reports by financial officers of women ever having expenditures associated with services designated as free were computed. These three sources of data (desk review, surveys of women and administrators) were triangulated, and chi-square analysis was conducted to determine if charges were levied differentially by standard equity stratifiers. Designation of services as free matched what was reported in the MNCAH Policy Survey for Argentina and Ghana. In India, insecticide-treated bed nets and testing and treatment for syphilis were only designated as free for selected populations, differing from the WHO MNCAH Policy Survey. Among 1046, 923, and 1102 women and accompanying persons who were interviewed in Argentina, Ghana, and India, respectively, the highest prevalence of associated expenditures among women who received a component service in each setting was for cesarean section in Argentina (26%, 24/92); family planning in Ghana (78.4%, 69/88); and postnatal maternal care in India (94.4%, 85/90). The highest prevalence of women ever having out of pocket expenditures associated with accessing any free service reported by financial officers was 9.1% (2/22) in Argentina, 64.1% (93/145) in Ghana, and 29.7% (47/158) in India. Across the three countries, self-reports of out of pocket expenditures were significantly associated with district/province and educational status of women. Additionally, wealth quintile in Argentina and age in India were significantly associated with women reporting out of pocket expenditures. CONCLUSIONS: Free care laws were largely accurately reported in the global MNCAH policy database. Notably, we found that women absorbed both direct and indirect costs and made both formal and informal payments for services designated as free. Therefore, the policy indicator does not provide a valid reflection of UHC in the three settings.

Validation of a measure to assess decision-making autonomy in family planning services in three low- and middle-income countries: The Family Planning Autonomous Decision-Making scale (FP-ADM).

BACKGROUND: Integrating measures of respectful care is an important priority in family planning programs, aligned with maternal health efforts. Ensuring women can make autonomous reproductive health decisions is an important indicator of respectful care. While scales have been developed and validated in family planning for dimensions of person-centered care, none focus specifically on decision-making autonomy. The Mothers Autonomy in Decision-Making (MADM) scale measures autonomy in decision-making during maternity care. We adapted the MADM scale to measure autonomy surrounding a woman's decision to use a contraceptive method within the context of contraceptive counselling. This study presents a psychometric validation of the Family Planning Autonomous Decision-Making (FP-ADM) scale using data from Argentina, Ghana, and India. METHODS AND FINDINGS: We used cross-sectional data from women in four subnational areas in Argentina (n = 890), Ghana (n = 1,114), and India (n = 1,130). In each area, 20 primary sampling units (PSUs) were randomly selected based on probability proportional to size. Households were randomly selected in Ghana and India. In Argentina, all facilities providing reproductive and maternal health services within selected PSUs were included and women were randomly selected upon exiting the facility. Interviews were conducted with a sample of 360 women per district. In total, 890 women completed the FP-ADM in Argentina, 1,114 in Ghana and 1,130 in India. To measure autonomous decision-making within FP service delivery, we adapted the items of the MADM scale to focus on family planning. To assess the scale's psychometric properties, we first examined the eigenvalues and conducted a parallel analysis to determine the number of factors. We then conducted exploratory factor analysis to determine which items to retain. The resulting factors were then identified based on the corresponding items. Internal consistency reliability was assessed with Cronbach's alpha. We assessed both convergent and divergent construct validity by examining associations with expected outcomes related to the underlying construct. The Eigenvalues and parallel analysis suggested a two-factor solution. The two underlying dimensions of the construct were identified as "Bidirectional Exchange of Information" (Factor 1) and "Empowered Choice" (Factor 2). Cronbach's alpha was calculated for the full scale and each subscale. Results suggested good internal consistency of the scale. There was a strong, significant positive association between whether a woman expressed satisfaction with quality of care received from the healthcare provider and her FP-ADM score in all three countries and a significant negative association between a woman's FP-ADM score and her stated desire to switch contraceptive methods in the future. CONCLUSIONS: Our results suggest the FP-ADM is a valid instrument to assess decision-making autonomy in contraceptive counseling and service delivery in diverse low- and middle-income countries. The scale evidenced strong construct, convergent, and divergent validity and high internal consistency reliability. Use of the FP-ADM scale could contribute to improved measurement of person-centered family planning services.

Validating indicators for monitoring availability and geographic distribution of emergency obstetric and newborn care (EmoNC) facilities: A study triangulating health system, facility, and geospatial data.

Availability of emergency obstetric and newborn care (EmONC) is a strong supply side measure of essential health system capacity that is closely and causally linked to maternal mortality reduction and fundamentally to achieving universal health coverage. The World Health Organization's indicator "Availability of EmONC facilities" was prioritized as a core indicator to prevent maternal death. The indicator focuses on whether there are sufficient emergency care facilities to meet the population need, but not all facilities designated as providing EmONC function as such. This study seeks to validate "Availability of EmONC" by comparing the value of the indicator after accounting for key aspects of facility functionality and an alternative measure of geographic distribution. This study takes place in four subnational geographic areas in Argentina, Ghana, and India using a census of all birthing facilities. Performance of EmONC in the 90 days prior to data collection was assessed by examining facility records. Data were collected on facility operating hours, staffing, and availability of essential medications. Population estimates were generated using ArcGIS software using WorldPop to estimate the total population, and the number of women of reproductive age (WRA), pregnancies and births in the study areas. In addition, we estimated the population within two-hours travel time of an EmONC facility by incorporating data on terrain from Open Street Map. Using these data sources, we calculated and compared the value of the indicator after incorporating data on facility performance and functionality while varying the reference population used. Further, we compared its value to the proportion of the population within two-hours travel time of an EmONC facility. Included in our study were 34 birthing facilities in Argentina, 51 in Ghana, and 282 in India. Facility performance of basic EmONC (BEmONC) and comprehensive EmONC (CEmONC) signal functions varied considerably. One facility (4.8%) in Ghana and no facility in India designated as BEmONC had performed all seven BEmONC signal functions. In Argentina, three (8.8%) CEmONC-designated facilities performed all nine CEmONC signal functions, all located in Buenos Aires Region V. Four CEmONC-designated facilities in Ghana (57.1%) and the three CEmONC-designated facilities in India (23.1%) evidenced full CEmONC performance. No sub-national study area in Argentina or India reached the target of 5 BEmONC-level facilities per 20,000 births after incorporating facility functionality yet 100% did in Argentina and 50% did in India when considering only facility designation. Demographic differences also accounted for important variation in the indicator's value. In Ghana, the total population in Tolon within 2 hours travel time of a designated EmONC facility was estimated at 99.6%; however, only 91.1% of women of reproductive age were within 2 hours travel time. Comparing the value of the indicator when calculated using different definitions reveals important inconsistencies, resulting in conflicting information about whether the threshold for sufficient coverage is met. This raises important questions related to the indicator's validity. To provide a valid measure of effective coverage of EmONC, the construct for measurement should extend beyond the most narrow definition of availability and account for functionality and geographic accessibility.

Validating midwifery professionals' scope of practice and competency: A multi-country study comparing national data to international standards.

BACKGROUND: There is a global shortage of midwives, whose services are essential to meet the healthcare needs of pregnant women and newborns. Evidence suggests that if enough midwives, trained and regulated to global standards, were deployed worldwide, maternal, and perinatal mortality would decline significantly. Health workforce planning estimates the number of midwives needed to achieve population coverage of midwifery interventions. However, to provide a valid measure of midwifery care coverage, an indicator must consider not only the raw number of midwives, but also their scope and competency. The tasks midwives are authorized to deliver and their competency to perform essential skills and behaviors provide crucial information for understanding the availability of safe, high-quality midwifery services. Without reliable estimates for an adequate midwifery workforce, progress toward ending preventable maternal and perinatal mortality will continue to be uneven. The International Labor Organization (ILO) and the International Confederation of Midwives (ICM) suggest standards for midwifery scope of practice and competencies. This paper compares national midwifery regulations, scope, and competencies in three countries to the ILO and ICM standards to validate measures of midwife density. We also assess midwives' self-reported skills/behaviors from the ICM competencies and their acquisition. METHODS AND FINDINGS: We compared midwives' scope of practice in Argentina, Ghana, and India to the ILO Tasks and ICM Essential Competencies for Midwifery Practice. We compared midwives self-reported skills/behaviors with the ICM Competencies. Univariate and bivariate analysis was conducted to describe the association between midwives' skills and selected characteristics. National scopes of practice matched two ILO tasks in Argentina, four in India, and all in Ghana. National standards partially reflected ICM skills in Categories 2, 3, and 4 (pre-pregnancy and antenatal care; care during labor and birth; and ongoing care of women and newborns, respectively) in Argentina (range 11% to 67%), mostly in India (range 74% to 100%) and completely in Ghana (100% match). 1,266 midwives surveyed reported considerable variation in competency for skills and behaviors across ICM Category 2, 3, and 4. Most midwives reported matching skills and behaviors around labor and childbirth (Category 2). Higher proportions of midwives reported gaining basic skills through in-service training and on-job-experience than in pre-service training. CONCLUSION: Estimating the density of midwives needed for an adequate midwifery workforce capable of providing effective population coverage is predicated on a valid numerator. A reliable and valid count of midwives to meet population needs assumes that each midwife counted has the authority to exercise the same behaviors and reflects the ability to perform them with comparable competency. Our results demonstrate variation in midwifery scopes of practice and self-reported competencies in comparison to global standards that pose a threat to the reliability and validity of the numerator in measures of midwife density, and suggest the potential for expanded authorization and improved education and training to meet global reference standards for midwifery practice has not been fully realized. Although the universally recognized standard, this study demonstrates that the complex, composite descriptions of skills and behaviors in the ICM competencies make them difficult to use as benchmark measures with any precision, as they are not defined or structured to serve as valid measures for assessing workforce competency. A simplified, content-validated measurement system is needed to facilitate evaluation of the competency of the midwifery workforce.

Authorization of midwives to perform basic emergency obstetric and newborn care signal functions in Argentina, Ghana, and India: A multi-country validation study of a key global maternal and newborn health indicator.

BACKGROUND: Midwives' authorization to deliver the seven basic emergency obstetric and newborn care (BEmONC) functions is a core policy indicator in global monitoring frameworks, yet little evidence supports whether such data are captured accurately, or whether authorization demonstrates convergence with midwives' skills and actual provision of services. In this study, we aimed to validate the data reported in global monitoring frameworks (criterion validity) and to determine whether a measure of authorization is a valid indicator for BEmONC availability (construct validity). METHODS: We conducted a validation study in Argentina, Ghana, and India. To assess accuracy of the reported data on midwives' authorization to provide BEmONC services, we reviewed national regulatory documents and compared with reported country-specific data in Countdown to 2030 and the World Health Organization Maternal, Newborn, Child and Adolescent Health Policy Survey. To assess whether authorization demonstrates convergent validity with midwives' skills, training, and performance of BEmONC signal functions, we surveyed 1257 midwives/midwifery professionals and assessed variance. RESULTS: We detected discrepancies between data reported in the global monitoring frameworks and the national regulatory framework in all three countries. We found wide variations between midwives' authorization to perform signal functions and their self-reported skills and actual performance within the past 90 days. The percentage of midwives who reported performing all signal functions for which they were authorized per country-specific regulations was 17% in Argentina, 23% in Ghana, and 31% in India. Additionally, midwives in all three countries reported performing some signal functions that the national regulations did not authorize. CONCLUSION: Our findings suggest limitations in criterion and construct validity for this indicator in Argentina, Ghana, and India. Some signal functions such as assisted vaginal delivery may be obsolete based on current practice patterns. Findings suggest the need to re-examine the emergency interventions that should be included as BEmONC signal functions.

Measuring adequacy of the midwifery workforce using standards of competency and scope of work: Exploring the density and distribution of midwives in three low- and middle-income countries using cross-sectional and geospatial data.

BACKGROUND: A global midwifery shortage hampers the goal of ending preventable maternal/newborn mortality and stillbirths. Whether current measures of midwifery workforce adequacy are valid is unknown. We compare two measures of density and distribution of midwifery professionals to assess their consistency, and explore how incorporating midwifery scope, competency, and the adjusting reference population impacts this critical metric. METHODS AND FINDINGS: We collected a census of midwives employed in eligible facilities in our study settings, (422 in Ghana; 909 in India), assessed the number practicing within the scope of work for midwifery professionals defined in the International Labor Organization International Standard Classification of Occupations, and whether they reported possessing the ICM essential competencies for basic midwifery practice. We altered the numerator, iteratively narrowing it from a simple count to include data on scope of practice and competency and reported changes in value. We altered the denominator by calculating the number of midwives per 10,000 total population, women of reproductive age, pregnancies, and births and explored variation in the indicator. Across four districts in Ghana, density of midwives decreased from 8.59/10,000 total population when counting midwives from facility staffing rosters to 1.30/10,000 total population when including only fully competent midwives by the ICM standard. In India, no midwives met the standard, thus the midwifery density of 1.37/10,000 total population from staffing rosters reduced to 0.00 considering competency. Changing the denominator to births vastly altered subnational measures, ranging from ~1700% change in Tolon to ~8700% in Thiruvallur. CONCLUSION: Our study shows that varying underlying parameters significantly affects the value of the estimate. Factoring in competency greatly impacts the effective coverage of midwifery professionals. Disproportionate differences were noted when need was estimated based on total population versus births. Future research should compare various estimates of midwifery density to health system process and outcome measures.

Improving measures of access to legal abortion: A validation study triangulating multiple data sources to assess a global indicator.

BACKGROUND: Global mechanisms have been established to monitor and facilitate state accountability regarding the legal status of abortion. However, there is little evidence describing whether these mechanisms capture accurate data. Moreover, it is uncertain whether the "legal status of abortion" is a valid proxy measure for access to safe abortion, pursuant to the global goals of reducing preventable maternal mortality and advancing reproductive rights. Therefore, this study sought to assess the accuracy of reported monitoring data, and to determine whether evidence supports the consistent application of domestic law by health care professionals such that legality of abortion functions as a valid indicator of access. METHODS AND FINDINGS: We conducted a validation study using three countries as illustrative case examples: Argentina, Ghana, and India. We compared data reported by two global monitoring mechanisms (Countdown to 2030 and the Global Abortion Policies Database) against domestic source documents collected through in-depth policy review. We then surveyed health care professionals authorized to perform abortions about their knowledge of abortion law in their countries and their personal attitudes and practices regarding provision of legal abortion. We compared professionals' responses to the domestic legal frameworks described in the source documents to establish whether professionals consistently applied the law as written. This analysis revealed weaknesses in the criterion validity and construct validity of the "legal status of abortion" indicator. We detected discrepancies between data reported by the global monitoring and accountability mechanisms and the domestic policy reviews, even though all referenced the same source documents. Further, provider surveys unearthed important context-specific barriers to legal abortion not captured by the indicator, including conscientious objection and imposition of restrictions at the provider's discretion. CONCLUSIONS: Taken together, these findings denote weaknesses in the indicator "legal status of abortion" as a proxy for access to safe abortion, as well as inaccuracies in data reported to global monitoring mechanisms. This information provides important groundwork for strengthening indicators for monitoring access to abortion and for renewed advocacy to assure abortion rights worldwide.